COMPLEX COOPERATIVE BEHAVIOUR IN RANGE-FREE FRUSTRATED 

MANY-BODY SYSTEMS 



< 



(N 



David Sherrington 

Rudolf Peierls Centre for Theoretical Physics, University of Oxford, 1 Keble Road, Oxford 0X1 3NP, UK. 

(Dated: 19 August 2008) 

A brief introduction and overview is given of the complexity that is possible and the challenges its 
study poses in many-body systems in which spatial dimension is irrelevant and naively one might 
have expected trivial behaviour. 



I. INTRODUCTION 



oo 

o 

O 

^ ' This paper is concerned with many body systems and their cooperative behaviour; in particular when that behaviour 
is complex and hard to anticipate from the microscopies, even qualitatively and even when the systems are made up 
of simple individual units with simple inter-unit interactions. 
' 'Range-free' (or 'infinite-ranged') refers to situations where the interactions are not dependent on the physical 
separations of individual units, and hence neither on the dimensionality nor on the structure of the embedding space. 
Such systems are also often referred to as 'mean- field', since one can often show (and usually believes) that their 
, behaviour in the thermodynamic limit (A^ oo units) is identical to that of an appropriate mean-field approximation 
Ch ' to a short-range system. 

jjy \ 'Frustration' refers to incompatability between different microscopic ordering tendencies. 
' ^ I Self-consistent mean-field theories do have the ability to describe spontaneous symmetry breaking and phase transi- 
. ' tions and they have played an important role in statistical physics. However as pure systems, without quenched 
, Hamiltonian disorder or out-of-equilibrium self-induced disorder, they do not exhibit the interesting non-simple 
' dimension-dependent but details-independent (universal) critical behaviour whose study drove much of the inter- 
I , est of statistical mechanics in the seventies and eighties [1]. For this reason 'mean-field' used to be interpreted as 
''O ■ fairly trivial. 

Ph \ On the other hand, with quenched disorder and frustration in their interactions range-free many-body systems can, 
O , and regularly do, exhibit behaviour that is complex and rich. This paper represents a brief introduction to and partial 
overview of such systems. 



> ' II. GENERAL STRUCTURE AND FEATURES 

o ■ 

, The general class of systems we consider can be summarized as characterised by schematic 'control functions' of 
ff^ ■ the form H[{Jij,,,k},{Si},X) where 

(i) in thermodynamics (statics) the {S*} are the variables and the {J} are quenched (frozen) parameters, or vice- versa, 
■ (ii) in dynamics the {5} are the 'fast' variables and the {J} are 'slow' variables, or vice-versa, where 'fast' and 'slow' 
\ refer to the characteristic microscopic time-scales, 

. (iii) in both cases, the X are intensive control parameters, influencing the system deterministically, qucnchcd-randomly 
' or stochastically, 
• ^ , and 

' (iv) we shall be particularly interested in typical behaviour in situations in which any quenched disorder is drawn inde- 
pendently from identical intensive distributions, enabling (at least in principle) useful thermodynamic-limit measures 
of the macroscopic behaviour. 

The interest arises when the effects of different interactions are 'frustrated', in competition with one another. In such 
cases with detailed balance, at low enough noise the macrostate structure/space is typically fractured (or clustered), 
in a manner often envisaged in terms of a 'rugged landscape' paradigm in which the dynamics is imagined as motion 
in a very high dimensional landscape of exponentially many hills and valleys, often hierarchically structured, with 
concomitant confinements, slow dynamics and history dependence. In dynamical systems without detailed balance, 
strictly there is no such simple Lyapunov 'landscape' but the 'motion' is analogously complexly hindered, with many 
effective macroscopic time-scales. 

First studied (in physics) in the context of magnetic alloys, such systems are now recognised in many different 
contexts; in inanimate physical systems, computer science, and information science; in animate biology, economics 
and social science. In these different systems 'controllers' of the 'control functions' vary; including the laws of physics, 
devisors of computer algorithms, human behaviour, governmentally-devised laws etc. 
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III. THE SHERRINGTON-KIRKPATRICK MODEL 

A simply-formulated but richly-behaved canonical model is that of Sherrington and Kirkpatrick (SK) [2], originally 
introduced as a potentially soluble model corresponding to a novel mean-field theory introduced by Edwards and 
Anderson (EA) [3] to capture the essential physics of some unusual magnetic alloys, known as spin glasses [4, 5]. 

The SK model is characterized by a Hamiltonian 

-ff = - ^ Jy CTiO-j; CT = ±1 (1) 

iv) 

where the i,j label spins <t, taken for simplicity as Ising, and the interactions {Jy } arc chosen randomly and inde- 
pendently from a distribution Pexch{Jij)- Dynamically the system can be considered to follow any standard single- 
spin-flip dynamics corresponding to a temperature T . Were normal equilibration to occur it would be characterized 
by Boltzmann-Gibbs statistics, p{a) ~ exp(— iJ{(T}/T). 

However, if the distribution Pexch{J) has sufficient variance compared with its mean and the temperature is suffi- 
ciently low, normal equilibration does not occur and complex macro-behaviour results beneath a transition tempera- 
ture. The interesting regime, known as the 'spin glass phase', occurs at intensive T if the variance of Pexch{J) scales 
with TV as J'^/N, the mean as Jq/N. As Parisi showed, in a series of papers {e.g. [6-8]) which involved amazing insight 
and highly original conceptualization and methodology, this glassy state is characterized by a hierarchy of 'mctastable' 
macrostates, differences between restricted and Gibbsian thermodynamic averages, as well as non-self-averaging; see 
also e.g. [9]. 

These features can be characterized by the macrostate overlap distribution hmctions P{q) = S' ^il ^ 
I J2i{'^i) si'^i) S' I) where (0)5 denotes a thermodynamic average of O over the macrostate S. For a conventional 
system, with a single macrostate, P{q) has a single delta function, while for a system with entropically extensively 
many macrostates P{q) has more structure. When the state structure is continuously hierarchical, as it is for SK, there 
is a continuum of weight in the disorder-averaged overlap distribution function _P((7) = J DJ[Y[{ij) Pexch{Jij)]P{jij}i'l)- 
Non-self-averaging arises in different P^j.^y{q) for different realizations of quenched disorder even when that disorder 
is chosen i.i.d. from an intensive Pexch{J)- Ultrametricity [8] is a feature of the hierarchical order. 

Later studies [10] have further exposed the existence of slow dynamics and aging and a remarkable non-trivial quan- 
titative relationship to the thermodynamics [11, 12]. One feature of this is a modification of the normal ffuctuation- 
dissipation relationship to —dR/dC = 13X{C) where i? is a response function and C a related correlation function, 
parenthetically connected through the measurement time t in the limits of large initial waiting time/field application 

time and t itself, and X{C) is related to the average overlap distribution P{q) by X{C) = P[q)dq. In the 
normal fluctuation-dissipation theorem X(C) is replaced by unity. 

The original exposure of the subtleties of the SK model utilised unusual and non-rigorous mathematics and ansatze, 
together with unconventional physical conceptualization, going far beyond the conventional realms of rigorous mathe- 
matical physics and probability theory. The predictions have however long been shown to be in accord with computer 
simulations of the model {e.g. [13]) and consequently were believed by physicists. Their rigorous demonstration, 
though, has been a non-trivial challenge which has required deep analysis and led to new rigorous mathematical 
methodologies in recent years [14-17], flnally completely vindicating Parisi's theory [18]. Thus there is no doubt that 
there is deep complexity in the SK model. 

On the other hand, while it is generally believed that real spin glass transitions do occur also in the short-ranged 
EA model for dimensions three or more and also in the experimental magnetic alloys that first stimulated its study, 
it remains controversial as to whether or to what extent all the subtle predictions of the SK model apply to these 
systems (see e.g. [11] [19]). 

Hence it becomes appropriate to ask whether range-free frustrated and disordered systems have a wider relevance 
beyond as over-idealized models of real magnetic alloys and as challenges for mathematicians. Possibly remarkably, 
it turns out that the answer is a resounding "Yes" ; they turn out to be rather ubiquitous in many areas of science. 

IV. BEYOND MAGNETIC ALLOYS 

Range-free frustrated and disordered many-body problems occur in many scenarios outside of physics, for example 
in many of the hard optimization problems studied by computer scientists, and in situations in which correlation 
between individuals occurs through the transfer of information available to all, irrespective of physical separation, as 
epitomised by modern interaction through the internet and telephones, or commonly available through the world-wide 
web, newspapers, radio and television. These systems are usually different in detail from the SK model but share 
some of the same conceptual and technical challenges, as well as providing further challenges of their own. 
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A. The SK model as an optimization exercise 

A simple illustration of the the possibilities of extension conies from viewing the SK model as an optimization 
problem which is describable in everyday terms as "The Dean's Problem" [20]. One imagines a University Dean who 
has to place N students in two dormitories, but with the challenge that every pair of students either likes or 
dislikes one another to an extent [53]. His problem is to choose to which dorm to allocate each student so as to 
ensure the greatest satisfaction overall. Labelling the dorm choices by (Ji = ±1 the SK Hamiltonian becomes the 'cost 
function' that the Dean should minimise, with the {ci} in its ground state the optimal choice[54]. Allowing the Dean 
a degree of uncertainty in his decision-making provides an analogue of 'temperature'. 

B. Simulated annealling 

There are many other combinatorial optimization problems that can be viewed as finding the minimum of a cost 
function of the form J^j . ^}, {Si}, X). 

In a 'simulated annealing' [21] 'spin-flip' computer algorithm to minimise the cost function, an annealing 'temper- 
ature' Ta is introduced artificially via a stochastic probability measure determined by exp(—SH/TA), where SH is 
the change in the cost function engendered by the flip, so that equilibration at Ta would yield the corresponding 
Boltzmann distribution, and Ta is gradually reduced to the value of interest (zero for a minimum of H, or T if that 
is the stochastic noise of actual uncertainty). Correspondingly. Ta can be introduced into an effective equilibrium 
statistical mechanics, with Boltzmann weighting cxTp{^ H {S} /Ta), examined analytically and the minimum found 
from Hmm = limT,i^o{-7AlnX]{s} exp(-i/{5}/rA)} 

C. p-spin spin glass, satisfiability and error-correction 

In the p-spin glass model one replaces the binary interaction of SK by one involving p spins; 

H = - ^ Jhi2..ipCriiCri2---<^ip, (2) 

(1112. .ip) 

with the J again drawn randomly and independently, all from the same distribution, and then quenched [55]. This 
apparently innocuous extension of the SK model yields new behaviour in several ways. Firstly, instead of a continuous 
onset of a hierarchy of different levels of metastability, with a growing continuous range of state overlaps, there is 
a discontinuous onset of many orthogonal but otherwise equivalent metastates of finite overlap order parameter 
[56] [25, 26]. Secondly, the dynamical transition is no longer at the same temperature as the thermodynamic transition 
but is higher [30] . Thirdly, there is another lower temperature (continuous) thermodynamic transition to a state with 
a continuous range of overlap distributions [31]. 

This type of behaviour, of a dynamical transition pre-empting a thermodynamic one, both with discontinuous onset 
of overlap, turns out to be rather common in frustrated many-body systems[57]. So too is the lower temperature 
thermodynamic transition to a continuous range of overlap distributions [58] . Consequently the determination of the 
minimum achievable cost function often has the difficulties associated with the full hierarchical character of the SK 
model at T = 0. 

In fact, many of the problems of interest in computer science are effectively range- free but on random graphs of 
finite connectivity, in contrast to the full connectivity of the SK- and p- spin models of eqns. (1) and (2) above. The 
conceptual ideas extend, albeit made more complicated (and currently incompletely solved) by the need for higher 
order overlap functions within the full (replica) theory of [2, 3, 6] [59]. Dilution, however, has also brought to the fore 
an alternative and highly successful computational methodology in the form of 'survey propagation' [24]. 

One example of the conceptual transfer of these ideas is to random satisfiability problems in computer science, 
both in explaining the existence of satisfiable-unsatisfiable (SAT-UNSAT) phase transitions [32] and in leading to 
the recognition that for random K{> 2)-SAT, where K refers to the length of the individual clauses to be satisfied 
simultaneously, there should be a region of 'HARD-SAT' separating practically satisfiable SAT problems from UNSAT 
as the constraint density, the ratio of the number of constrained clauses to the number of variables, is increased [28]; 
this ratio can be considered as playing a role reminiscent of that of the inverse of temperature in the p-spin model with 
the transitions analogues of the p-spin dynamical and thermodynamic transitions [60]. In fact, on closer examination, 
random /v-SAT exhibits an even richer sequence of phase transions; see e.g. [29]. 

It is possible to interpolate between the type of behaviour of the p > 3 model and that of the p = 2 SK model. One 
way is to add a magnetic field h to the p-spin glass. This leads to a sequence of behaviours as h is increased; for small 
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h it is qualitatively as described above for the zero-field p-spin model, followed at a first critical field by the coming 
together of the dynamical and thermodynamic spin glass transitions and replacement of the discontinuous onset of 
non-trivial P{q) by a continuous one [30], but still with a single delta function onset at non-zero q, in addition to 
that at g = 0, and then at a higher critical field by a transition to a continuously distributed hierarchy of metastable 
states and overlaps[61]. This suggests a possible utility in adding an extra 'effective field' in the computer algorithmic 
optimization, to avoid the dynamical pre-emption of a thermodynamic transition. 

D. Interacting agents 

Another interesting class of range-free problems is of systems where many 'agents', each with individual characteris- 
tics but with no direct interactions between them, behave in a cooperatively complex fashion by all reacting to common 
'information'. This common information acts as an effectuator for correlation between the agents. Frustration and 
complexity arise when the goals are such that not all can 'win'. 

1. The Minority Game 

A minimalist model that illustrates this class is the so-called 'Minority Game'(MG)[35, 36], introduced to emulate 
some features of a stockmarket in which players make profits by buying when the price is low and selling when the 
price is high. In a simple version of this model TV agents at each time-step t simultaneously make one of two choices, 
which we shall denote ±1. Their 'objectives' arc to make the minority choice. They make their choices on the basis of 
(i) some 'information' I(t) commonly available to all. (ii) the operation on that information by each agent i of one of 
a pair of individual strategy operators S^;a = -I-,—, with the output determining the 'choice' made, (iii) individual 
'point-scores' Pi{t) that enable the agents to 'decide' which of their two strategies to employ at each step. The strategy 
pairs are chosen randomly and independently at the outset and thereafter fixed. The information I(t) varies at each 
time-step and hence so does the outcome of the strategies acting upon it . The space of the strategies spans the two 
possible outputs equally. In the simplest deterministic version of the game the strategy S" employed by agent i at 
time t is that labelled by the same sign as pi (t) . The points are updated according to 

P^it + 1) = pm [5f*^'^(P-(*»(I(t))]A(t) (3) 

where [S'"(I)] — ±1 is the action choice of the strategy S" acting on the information I and and A{t) is the average 
'choice' over the stategies actually employed, 

A{t)=N-'Y.iSr^"'^'^\ntm (4) 
j 

i.e. by increasing the point-score bias for strategies leading to minority behaviour. In the original formulation [37] the 
information used was the Booolean string indicating the minority choice in the previous m time-steps of play and the 
S were Boolean operators. However, essentially similar behaviour is obtained for a system in which I{t) is randomly 
generated at each time t, equally probably from the whole space of m binaries [38]. 

The most obviously relevant macroscopic measure in the MG is the volatility, the variance of the choices. Computer 
simulations demonstrated that it has scaling behaviour, the volatility per agent versus the the information dimension 
per agent d = D/N = 2"^/N approaching independence of TV as the latter is increased, and also has a cusp-like 
minimum at a critical dc with behaviour ergodic for d > dc but non-crgodic for d < dc [62]. Fig 1 shows this 
behaviour for a slightly different variant of the model in which the strategies are taken as D = c?TV-dimensional binary 
strings Sf = {S"'^ , S"'^ , ....S'j^'^};i = 1,..TV, a = ±, with each component S'^'^;fi = 1,..D chosen randomly and 
independently at the outset and thereafter fixed (quenched), and the stochastic 'information' consists in randomly 
choosing ^(t) at each time-step and then using the corresponding strategy elements. This is reminiscent of the 
behaviour of the susceptibility of the SK spin glass, shown in Fig 2, if one compares the volatility with the inverse 
susceptibility and the information dimension with the temperature. Hence one is tempted to analyze the MG using 
methodolgy developed for spin glasses. 

Updating the point-score only after M steps where AI > 0{N) leads to an averaging over the random information 
to produce an effective interaction between the agents and yield the so-called 'batch' game (with tcmporally-rescaled 
update dynamics) 



Piit + 1) =Pi{t) - ^ JijSgn{pj{t)) ~hi= pi{t) - dH/dsi |si=sgn(pi(t)); 

3 



(5) 
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FIG. 1: Volatilities in Minority Games with 2 strategies per agent; Shown are (i) different biases of initial point asymmetries 
between each agent's 2 strategies: Pi{0) = 0.0 (circles), 0.5 (squares) and 1.0 (diamonds), (ii) a comparison betweeen the results 
of simulation of the deterministic many-agent dynamics (open symbols) and the numerical evaluation of the analytically-derived 
stochastic single-agent ensemble dynamics. From [39]. 




FIG. 2: Schematic susceptibility of the SK spin glass in an applied field H, as predicted by Parisi theory. The upper curve 
shows the full Gibbs average, obtained from the full q{x) and interpreted as the field-cooled (FC) susceptibility. The lower 
curve shows the result of restricting to one thermodynamic state, as obtained from q{l) and interpreted as the zero-field-cooled 
susceptibility. From [40]. 



where H is an effective 'Hamiltonian' 

H ^'^JijSiSj + hiSi (6) 
(y) 

and Jij and hi are effective 'exchange' and 'field' terms given by 

/^— 1 M— 1 

where oJi = {S\ + S^)/2, = (S^^ — S|)/2. Since the S are random so are the exchange and field terms. Hence iJ is a 
disordered and frustrated control function. The expression for the {Jij} is very reminiscent of the Hebbian-inspired 
synapses of the Hopfield neural network model [41], where the {^f } are the stored memories, but crucially with the 
opposite sign ensuring that here the {Cf } arc now repellors rather attractors[63]. 



Methodologies 



There are two main methodologies employed to study statics, the replica procedure and the cavity method (see e.g. 
[9]). The most common method for the cooperative dynamics is the generating functional method [42, 43]. 
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In the replica method one studies the disorder-averaged free energy 

J i?{J}Pe.c/.({J})(-rhiTr{,jexp(-i/{,;j({a})/T)), (8) 

using the identity InZ = Lim„^o{-^" ~ l}/*^! identifying the power n as describing n repUcas, a = l,..n; with n 
eventuaUy taken to 0. Macroscopic order parameters are introduced through multipHcation by unity of the form 

1 - / n Dq^-^Siq-" Y.^<^?<^^) H^„l (9) 

(a/3) 

where the a, (3 label replicas and i^e// is the effective Hamiltonian after disorder averaging. The microscopic variables 
{erf} are integrated out and the dominant extremum [64] with respect to the q°'^ is taken in the limit N — > oo. In the 
most natural asantz, replica symmetry among q°'^]a ^ (3 was assumed [2, 3], but this proved to be too naive. The 
correct solution for the SK model requires Parisi's much more subtle ansatz of replica symmetry breaking [6]. This 
ansatz introduces a hierarchy of spontaneous replica symmetry breaking (RSB) with a sequence of qi,Xi;i = 1, ..K 
that in the limit oi K oo yields a continuous order function q{x) : < x < 1, later shown [7] to be related to the 
average overlap distribution through P{q) = J dxS{q — q{x)). 

The dynamical functional method for the SK model is discussed in [10, 19]. Here we describe instead its use for 
the Minority Game [36] . A generating functional can be defined by 

Z = [ Yldpit)Wipit + 1) 1 p(<))Po(p(0)), (10) 

where p{t) — {pi{t), . . . ,pN{t)), W{p{t + 1) | p(t)) denotes the transformation operatation of eqn. (5) and Po(p(0)) 
denotes the probability distribution of the initial score differences. 

Averaging over the specific choices of quenched strategies, introducing macroscopic two-time correlation order 
functions via 



1 = y n ^C-lt, t')5{C{t, t') ~ N-^ signp.(t)signp,(t')) (H) 



and similar expressions for response functions G{t, t') and derivative- variable correlators K{t, t'), and integrating out 
the microscopic variables, the averaged generating functional may then be transformed exactly into a form 

Z = y L»CDC£)GDGL>Ki:>Kexp(iV$(C,C,G,G,K,K) , (12) 

where $ is iV- independent, the bold-face notation denotes matrices in time and the tilded variables are complementary 
ones introduced to exponentiate the delta functions in eqn. (IV Dl) and its partners. Being extremally dominated, 
in the large- limit this yields the effective single agent stochastic dynamics 



p{t + 1) = p{t) - a ^(1 + G);Jsgnp{t') + V^7j{t), (13) 
t'<t 



where r]{t) is coloured noise determined self-consistently over the corresponding ensemble by 

MtHt')) = [(1 + G)-i(l + C)(l + G^)-%,. (14) 

Fig. 1 demonstrates the veracity of this result in a comparison of the results of computer simulation of the original 
deterministic many-body problem eqn. (11) and the numerical evaluation of the self-consistently noisy single- agent 
ensemble of eqn. (13). 

The analogous equations for the p-spin spherical spin glass formed the basis for recognition of the dynamical 
transitions mentioned earlier and the existence of aging solutions and modifications to conventional fluctuation- 
dissipation relations. 



V. CRITICAL BEHAVIOUR AND CORRELATION LENGTH 



Having commented earlier that standard non-frustrated non-disordered infinite-ranged systems do not have inter- 
esting critical behaviour, it is relevant to note that again frustrated disordered systems are different [46, 47, 49, 50], 
having interesting critical behaviour at low temperature and applied magnetic field, even though mean-field. 
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Parisi replica symmetry breaking involves an infinite sequence of hierarchies. ii'-RSB has K step-breaks in the 
order function q{x) : < x < 1 [65]. The exact free energy is formally obtained by finding the supremum with respect 
to the break and plateau values qi, Xi and taking K oo [6, 18]. The continuum limit was given as a set of implicit 
equations already in Parisi's early work [66]. Most (but not all) of the subsequent analysis has been perturbative near 
to the transition temperature for spin glass onset [67]. Numerical evaluations have until a couple of years ago been 
restricted to just the first few steps of RSB, but very recently very high accuracy numerical extremizations for high 
orders of RSB have been performed at zero and low temperatures and have shown interesting features [46-49] . 

At low temperatures the steps Xi scale T with the having non-zero limits as T — s- and exposing critical 

points at both a ~ Q and a ~ oo. As T ^ c» the iC-step approximation of qi against approaches a fixed-point 
function q* [a) of form close to q*{a) = (v^/2a)erf(^/a) with ^ a 'correlation function' in a-space given by ^ « '^IV^ 
[68]. The degree of RSB can be viewed as an effective one-dimensional lattice of size if, with K ^ oo the analogue of 
the infinite- length lattice (or thermodynamic) limit. Similarly, finite- ii' approximation yields an analogue of finite-size 
effects, including finite-size scaling. Note however that this new type of finite-size scaling is for a mean-field problem 
in the thermodynamic limit and is in a space of degree of approximation. There are also finite K-size scalings when 
the system is perturbed away from the T = critical point (at a = 0) and for finite applied field h near a = oo 
[49]. Correspondingly there are further 'correlation lengths' in temperature-deviation and in field-deviation, which of 
course also determine the extent of RSB needed to get a good approximation as temperature or field become non-zero. 

Conclusions 

In this short paper it has only been possible to present a brief and non-detailed vignette of the complexity that can 
and does exist in disordered and frustrated many-body systems, even within a dimension-free mean-field situation. 
The puzzles, intrigues and challenges have developed and been a source of intense study for over 30 years. Finite-range 
systems have also been a great source of interest, again with significant progress but still subject to some controversy 
[44, 45]. 

The case of systems with variables having different fundamental timescales, such as fast neurons and slow synapses 
or evolutionary models with different timescales for phenotypes and genotypes, have not been discussed. Nor has 
the problem of dynamical sticking in effectively self-determined disordered states of some systems without quenched 
disorder in their control functions but started far from equilibrium. 

Also, in this brief review, only some of the simplest models have been described. It is however clear that many 
extensions and more realistic/complete scenarios exist that arc still effectively range-free, yet complex, interesting and 
challenging. 
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